<html>
<head><meta charset="utf-8"><title>ui test annotations · t-compiler/help · Zulip Chat Archive</title></head>
<h2>Stream: <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/index.html">t-compiler/help</a></h2>
<h3>Topic: <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html">ui test annotations</a></h3>

<hr>

<base href="https://rust-lang.zulipchat.com">

<head><link href="https://rust-lang.github.io/zulip_archive/style.css" rel="stylesheet"></head>

<a name="163145446"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/182449-t-compiler/help/topic/ui%20test%20annotations/near/163145446" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> ange <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html#163145446">(Apr 11 2019 at 23:13)</a>:</h4>
<p>What is the point of machine-checked annotations in testcases when you <em>have</em> to capture all error output for the <code>ui</code> tests anyway?</p>



<a name="163145653"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/182449-t-compiler/help/topic/ui%20test%20annotations/near/163145653" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> ange <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html#163145653">(Apr 11 2019 at 23:16)</a>:</h4>
<p>(I'm asking because getting the exact compiler output right for a testcase that cannot yet pass is much more involved than simply saying "I'm expecting this error here")</p>



<a name="163147362"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/182449-t-compiler/help/topic/ui%20test%20annotations/near/163147362" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> davidtwco <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html#163147362">(Apr 11 2019 at 23:50)</a>:</h4>
<p>If you pass <code>--bless</code> then it updates all the ui test output. It's easy to do this and miss that you've accidentally blessed a regression (a missing error, say) if there are a lot of changed tests. By also using annotations, you need to acknowledge that a test lost an error.</p>



<a name="163147628"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/182449-t-compiler/help/topic/ui%20test%20annotations/near/163147628" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> ange <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html#163147628">(Apr 11 2019 at 23:56)</a>:</h4>
<p>Thanks, that makes sense. So I guess the reason you can't just have an <code>annotations-cover-all-expected-error-output</code> header command is to make sure one doesn't miss subtle changes in the formatting of the output and instead needs to explicitly <code>--bless</code> them?</p>



<a name="163165456"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/182449-t-compiler/help/topic/ui%20test%20annotations/near/163165456" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> davidtwco <a href="https://rust-lang.github.io/zulip_archive/stream/182449-t-compiler/help/topic/ui.20test.20annotations.html#163165456">(Apr 12 2019 at 07:02)</a>:</h4>
<p>Exactly, without stderr files we’d miss small things like a span changing.</p>



<hr><p>Last updated: Aug 07 2021 at 22:04 UTC</p>
</html>